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U  sing  limited  assets,  an  interdictor  attempts  to  destroy  parts  of  a  capacitated  network  through  which  an  adversary  will  subsequently 
maximize  flow.  We  formulate  and  solve  a  stochastic  version  of  the  interdictor's  problem:  M  inimize  the  expected  maximum  flow 
through  the  network  when  interdiction  successes  are  binary  random  variables.  Extensions  are  made  to  handle  uncertain  arc 
capacities  and  other  realistic  variations.  These  two-stage  stochastic  integer  programs  have  applications  to  interdicting  illegal  drugs 
and  to  reducing  the  effectiveness  of  a  military  force  moving  materiel,  troops,  information,  etc.,  through  a  network  in  wartime.  Two 
equivalent  model  formulations  allow  J  ensen's  inequality  to  be  used  to  compute  both  lower  and  upper  bounds  on  the  objective,  and 
these  bounds  are  improved  within  a  sequential  approximation  algorithm.  Successful  computational  results  are  reported  on  networks 
with  over  100  nodes,  80  interdictable  arcs,  and  180  total  arcs. 


This  paper  investigates  stochastic  variants  of  a  network 
interdiction  problem  where  an  "interdictor,"  using 
limited  assets,  "interdicts”  (destroys  or  at  least  stops  the 
use  of)  parts  of  a  capacitated  network  through  which  an 
adversary  will  subsequently  maximize  flow.  The  determin¬ 
istic  problem  is  to  minimize  the  maximum  achievable  flow 
through  the  network  subject  to  constraints  on  interdiction 
resources.  In  the  stochastic  variants,  interdiction  successes 
can  be  uncertain  and/or  arc  capacities  can  be  random  vari¬ 
ables.  The  objective  of  these  stochastic  network  interdic¬ 
tion  problems  is  to  minimize  the  expected  maximum  flow 
through  the  network  by  selecting  the  best  set  of  arcs  to 
interdict,  or  to  attempt  to  interdict. 

The  deterministic  network  interdiction  problem  has 
been  studied  in  M  cM  asters  and  Mustin  (1970),  Steinrauf 
(1991),  Phillips  (1992),  and  Wood  (1993),  with  military 
applications  and  with  applications  to  the  interdiction  of 
illegal  drugs  and  precursor  chemicals.  Game-theoretic  net¬ 
work  interdiction  models  have  also  been  studied  (Wollmer 
1964,  Washburn  and  Wood  1995),  but  these  models  are 
substantially  different:  they  determine  optimal  arc- 
inspection  strategies  for  detecting  an  evader  moving 
through  a  network  surreptitiously. 

Our  analysis  of  stochastic  network  interdiction  begins 
with  this  basic  problem:  We  wish  to  interdict  arcs  in  a 
network  so  as  to  minimize  the  expected  maximum  flow 


from  a  source  node  s  to  a  sink  node  t.  Assets  available  to 
perform  these  interdictions  are  limited.  Interdiction  suc¬ 
cesses  are  assumed  to  be  independent  binary  random  vari¬ 
ables  such  that  an  unsuccessful  interdiction  attempt  on  an 
arc  leaves  the  arc  with  its  nominal  capacity,  and  a  success¬ 
ful  interdiction  leaves  the  arc  with  no  capacity. 

A  stochastic  maximum  flow  problem  cannot  be  solved  by 
solving  a  deterministic  maximum  flow  problem  where  ran¬ 
dom  arc  capacities  are  replaced  by  their  expected  values. 
Likewise,  our  interdiction  problem  cannot  be  solved  via 
the  deterministic  "expected-value  problem"  (Birge  1982) 
that  minimizes  maximum  flow  assuming  uninterdicted  arcs 
have  nominal  capacities  and  interdicted  arcs  have  their 
expected  residual  (after-interdiction)  capacities.  Consider 
the  simple  interdiction  problem  represented  in  Figure  1, 
where  each  arc  is  marked  with  its  nominal  capacity.  As¬ 
sume  that  the  probability  of  a  successful  interdiction  on 
any  arc  is  0.6,  at  most  one  interdiction  on  each  arc  may  be 
attempted,  and  resources  limit  the  number  of  interdictions 
to  two.  The  expected-value  problem  selects  arcs  (s,  t)  and 
(s,  2),  or  arcs  (s,  t)  and  (2,  t)  for  interdiction.  The  capacity 
of  the  network  based  on  expected  capacities  following  in¬ 
terdiction  is  (1  -  0.6)10  +  (1  -  0.6)100  =  44.  This  capac¬ 
ity  would  be  (1)10  +  (1  -  0.6)100  =  50  if  arcs  (s,  2)  and 
(2,  t)  were  interdicted,  since  nothing  is  gained  in  a  deter¬ 
ministic  model  by  interdicting  identical  arcs  in  series.  The 
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Figure  1.  Interdiction  decisions  based  on  expected  resid¬ 
ual  arc  capacities  may  be  incorrect. 


correct  solution  is  to  interdict  arcs  (s,  2)  and  (2,  t)  leaving 
the  stochastic  network  with  an  expected  capacity  (and  ex¬ 
pected  maximum  flow)  of  (1)10  +  (1  -  0.6)2100  =  26.  It  is 
clear  that  the  expected-value  model  above  will  always  in¬ 
terdict  arcs  that  are  part  of  some  cut,  say  C  (other  irrele¬ 
vant  arcs  may  be  interdicted  if  the  interdiction  budget  is 
sufficient),  yet  the  correct  solution  may  be  to  interdict  arcs 
that  cannot  all  belong  to  the  same  cut  C. 

We  first  formulate  the  stochastic  network  interdiction 
problem  (SNIP),  as  in  the  above  example,  with  uncertain, 
binary  interdiction  successes,  "SNIP(IB)."  This  problem  is 
a  two-stage  stochastic  program  with  recourse,  but  it  has  an 
unusual  "min-max"  objective.  The  integer  first-stage  deci¬ 
sion  variables  represent  the  interdictor’s  choice  of  which 
arcs  to  attempt  to  destroy.  After  this  decision  has  been 
implemented,  a  random  subset  of  the  interdiction  attempts 
is  successful  and  completely  destroy  the  corresponding 
arcs,  i.e.,  drop  their  capacities  to  zero.  U  nsuccessful  inter¬ 
diction  attempts  have  no  effect  on  the  network.  With  com¬ 
plete  knowledge  regarding  the  status  of  the  residual 
network,  the  adversary  solves  the  continuous  recourse 
problem  of  maximizing  flow  through  this  network.  Our 
goal,  i.e.,  the  interdictor’s  goal,  is  to  select  arcs  to  attempt 
to  interdict  so  as  to  minimize  the  expected  value  of  the 
maximum  flow  that  the  adversary  can  achieve. 

We  also  develop  several  variants  of  SNIP(IB): 

(a)  SNIP(ICB)  has  uncertain,  binary  interdiction  suc¬ 
cesses  and  uncertain,  binary  arc  capacities  (the  capacity  of 
an  arc  can  take  on  one  of  two  nonnegative  values);  (b) 
SNIP(CB)  has  uncertain,  binary  arc  capacities;  (c) 
SNIP(CD)  has  uncertain  arc  capacities  that  can  take  on  a 
finite  number  of  nonnegative  values;  and  (d)  SNIP(IM) 
allows  multiple  uncertain  interdictions  on  an  arc.  These 
are  realistic  variants  of  the  initial  model.  For  instance, 
SNI  P(CB)  could  be  used  when  the  very  existence  of  an  arc 
in  the  adversary’s  network  is  uncertain  because  of  incom¬ 
plete  intelligence. 

A  large-scale  deterministic  equivalent  binary  integer 
program  may  be  formed  for  SNI  P(l  B)  by  (a)  reformulating 
the  problem  as  a  simple  minimization  problem  involving 
binary  interdiction  variables  and  binary  second-stage  vari¬ 
ables  (these  are  related  to  dual  variables  of  a  maximum 
flow  problem),  and  (b)  enumerating  all  possible  realiza¬ 
tions  of  the  network  with  respect  to  the  success  or  failure 
of  each  possible  interdiction.  Analogous  models  can  be 
built  for  the  other  SNIPs.  Unfortunately,  solving  such 


models  would  be  computationally  impractical  for  all  but 
the  smallest  problems. 

The  stochastic  programming  literature  suggests  that  se¬ 
quential  approximation  techniques  (e.g.,  Kail  et  al.  1988 
and  Frauendorfer  1992)  coupled  with  decomposition  algo¬ 
rithms  (Van  Slyke  and  Wets  1969)  are  practical  methods 
for  solving  difficult  stochastic  programming  problems  such 
as  the  SNIP  variants;  we  use  this  approach.  A  sequential 
approximation  algorithm  successively  refines  lower  and  up¬ 
per  bounds  on  the  optimal  objective  value  as  it  divides  the 
state  space  of  the  random  variables  into  finer  and  finer 
partitions.  For  solving  a  minimization  problem,  such  an 
algorithm  typically  applies  Jensen’s  inequality  to  obtain 
lower  bounds  and  applies  the  Edmundson-M  adansky  in¬ 
equality  (Madansky  1959)  or  some  other  technique,  for 
fixed  values  of  the  first-stage  variables,  to  obtain  upper 
bounds.  The  lower  bound  is  usually  easy  to  compute  and 
the  upper  bound  difficult. 

The  stochastic  network  interdiction  problem  is  a  minimi¬ 
zation  with  respect  to  the  first-stage  variables  and  has  ran¬ 
dom  parameters  appearing  in  the  right-hand  side  of  the 
second  stage.  T ypically,  J  ensen's  inequality  is  used  to  com¬ 
pute  a  lower  bound  in  such  situations,  but  because  our 
second-stage  problem  is  a  maximization,  it  is  the  upper 
bound  that  is  easy  to  compute  via  J  ensen's  inequality.  W e 
are  able  to  use  this  bound  effectively,  so  the  key  to  solving 
our  problem  is  to  develop  an  efficient  lower-bounding 
method.  We  do  this  by  reformulating  the  model  to  move 
the  random  variables  into  the  objective  of  the  second  stage 
and  by  applying  J  ensen’s  inequality  again. 

One  might  attempt  to  modify  standard  upper-bounding 
techniques  (for  minimization  problems)  to  obtain  a  lower 
bound;  e.g.,  the  Edmundson-M  adansky  bound  (M  adansky 
1959),  a  piecewise-linear  bound  (Birge  and  Wets  1989, 
Wallace  1987b,  Birge  and  Wallace  1988),  and  a  bound  for 
problems  with  "convex  marginal  return  functions"  (Dono¬ 
hue  and  Birge  1995a,  1995b).  For  binary  interdiction  suc¬ 
cesses,  the  Edmundson-M  adansky  bound  is  equivalent  to 
enumerating  the  state  space  of  the  random  variables, 
which  is  impractical.  The  Donohue-Birge  approach  re¬ 
duces  computational  effort  relative  to  the  Edmundson- 
M  adansky  bound,  but  can  still  require  work  that  is 
exponential  in  the  size  of  the  network.  The  outer  minimi¬ 
zation  of  our  min-max  problems  would  be  difficult  to  carry 
through  to  those  bounds  (for  reasons  of  convexity  dis¬ 
cussed  below),  but  would  probably  be  impossible  to  carry 
through  for  a  piecewise-linear  bound.  One  might  also  at¬ 
tempt  to  adapt  a  specialized  lower  bound  for  the  stochastic 
maximum  flow  problem,  in  particular,  the  bound  of  Aneja 
and  Nair  (1980).  This  bound  involves  products  of  arc  reli¬ 
abilities  and  these  lead  to  an  undesirable,  nonlinear 
bounding  model  for  interdiction.  Our  reformulation  tech¬ 
nique  avoids  all  of  the  above  difficulties. 

As  we  show,  the  recourse  function  to  the  interdiction 
problem,  in  its  "natural  formulation,"  is  a  concave  function 
of  the  interdiction  decisions,  when  these  first-stage  vari¬ 
ables  are  viewed  as  continuous.  Since  we  want  to  minimize 
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the  expected  recourse  function,  this  precludes  application 
of  the  "standard"  integer  version  of  the  L -shaped  method 
(V an  Slyke  and  Wets  1969).  H  owever,  we  derive  an  equiv¬ 
alent  formulation  of  the  recourse  problem  that,  for  given 
interdiction  successes,  is  a  convex  function  of  the  first- 
stage  decision  variables  and,  for  fixed  first-stage  decisions, 
is  a  convex  function  of  interdiction  success  parameters. 
The  second  type  of  convexity  allows  us  to  apply  J  ensen’s 
inequality  to  obtain  a  lower  bound  for  fixed  first-stage  de¬ 
cisions,  and  the  first  type  of  convexity  allows  us  to  obtain  a 
global  lower  bound  by  minimizing  a  convex  function  using 
the  L -shaped  method.  Our  method  is  efficient  because  we 
compute  both  lower  and  upper  bounds  through  Jensen’s 
inequality,  and  this  computation  does  not  depend  on  the 
number  of  stochastic  parameters. 

Our  algorithm,  applied  to  SNIP(IB),  uses  a  state-space 
partitioning  scheme  that  recursively  conditions  on  whether 
or  not  a  specific  interdiction  would  be  successful  if  at¬ 
tempted.  Partitioning  is  similar  for  the  other  variants.  For 
instance,  in  SN I  P(CB),  we  can  sequentially  refine  the  par¬ 
tition  by  conditioning  on  whether  or  not  a  particular  arc’s 
capacity  exists  or  not.  The  gap  between  upper  and  lower 
bounds  on  the  optimal  objective  value  is  continually  tight¬ 
ened  with  iteratively  refined  partitions  of  the  state  space. 

The  models  we  develop  are  all  meant  for  interdicting 
arcs  in  a  directed  network  but,  in  some  networks  such  as 
road  and  communications  networks,  undirected  arcs  and 
node  interdiction  could  be  important.  Our  basic  models 
can  be  easily  modified  to  deal  with  these  variations.  The 
standard  transformation  of  an  undirected  arc  into  two  di¬ 
rected  arcs  in  anti-parallel  (e.g.,  Ahuja  et  al.  1993,  p.  38) 
will  convert  undirected  arcs  appropriately.  Only  slight 
modifications  of  our  models  would  be  needed  to  accom¬ 
modate  the  resulting  dependent  pairs  of  directed  arcs.  A  n- 
other  standard  transformation  converts  nodes  into 
directed  arcs  (e.g.,  Ahuja  et  al.,  p.  41-43). 

Our  techniques  have  applications  to  areas  beyond  net¬ 
work  interdiction.  When  no  arcs  can  be  interdicted  or  suf¬ 
ficient  resources  exist  to  interdict  every  arc,  SNIP(ICB) 
simplifies  to  a  stochastic  maximum  flow  problem  (e.g., 
Carey  and  Hendrickson  1984,  Evans  1976);  see  Section  5. 
If  we  convert  the  objective  of  SNIP(CB)  from  "min-max” 
to  "max-max”  and  reformulate  interdiction  as  capacity  ex¬ 
pansion,  the  resulting  problem  is  a  two-stage  stochastic 
program  where  expected  maximum  flow  can  be  improved 
by  making  investments  in  network  infrastructure.  This 
problem  has  been  studied  by  Wallace  (1987a),  but  our 
bounds  would  allow  an  alternate  solution  approach.  The 
"vulnerability”  of  networks  to  attack  or  arc  failure  has 
been  the  topic  of  a  number  of  papers  that  are  largely 
theoretical  in  nature  (e.g.,  Caccetta  1984,  Goddard  1994). 
Our  models  or  variants  of  them  could  be  used,  at  least  in 
an  ad  hoc  fashion,  for  studying  vulnerability  from  a  more 
practical  point  of  view.  Finally,  we  note  that  our  bounding 
techniques  can  be  generalized  for  use  in  other  stochastic 
programming  problems;  see  Section  6. 


Network  concepts  and  notation  are  defined  in  the  next 
section  and  a  key  theorem  is  provided  that  will  lead  to  two 
equivalent  formulations  of  SNIP(IB).  Section  2  describes 
the  deterministic  network  interdiction  problem  and  the 
stochastic  variant  that  isSNIP(IB).  It  also  derives  objective 
function  bounds  for  use  in  the  algorithm  that  is  then  de¬ 
scribed  in  Section  3.  Section  4  describes  extensions  of 
SNIP(IB)  that  allow  uncertain  arc  capacities,  certain  com¬ 
binations  of  random  capacities  and  interdiction  attempts, 
and  multiple  interdiction  attempts.  Section  5  provides 
computational  results  for  SNIP(IB),  SNIP(ICB)  and  for  a 
special  case  of  SNIP(ICB)  when  no  arcs  may  be  interdict¬ 
ed— this  is  the  classic  stochastic  maximum  flow  problem  in 
a  network  with  unreliable  arcs.  The  paper  is  summarized 
in  Section  6. 

1.  PRELIMINARIES 

Let  G  =  (N ,  A)  denote  a  directed  network  with  node  set  N 
and  arc  set  A .  An  arc  is  an  ordered  of  pair  of  nodes  (/,  j) 
where  /  is  the  tail  of  the  arc  and  j  is  the  head  of  the  arc. 
The  set  of  arcs  directed  out  of  a  node  /,  i.e.,  with  tail  /,  is 
the  forward  star  of  i,  denoted  F S(/).  The  set  of  arcs  di¬ 
rected  into  node  /,  i.e.,  with  head  /,  is  the  reverse  star  of  i, 
denoted  RS(/). 

A  single  commodity  flows  through  the  arcs  of  G  from  a 
source  node  s  to  a  sink  node  t.  The  flow  on  any  arc  cannot 
exceed  its  capacity,  u,j.  Let  (t,  s)  be  an  artificial  return  arc 
associated  with  G  and  define  A'  =  Au{(t,  s) },  uts  = 
2(ij)EAUij  +  1,  and  redefine  FS(  )  and  RS(  )  to  include 
the  return  arc.  The  problem  of  finding  the  maximum  fea¬ 
sible  flow  from  s  to  tin  G ,  i.e.,  the  maximum  flow  problem 
on  G ,  is  given  by  the  following  linear  program  (LP)  which 
maximizes  the  flow  on  the  return  arc  subject  to  arc  capac¬ 
ities  and  flow  balance  constraints: 

M  AX  FLOW 

max  xts, 

X 

s.t.  s  Xjj  —  E  Xji  =  o  view,  (1) 

(i.j)eFS(i)  ttOefiSf/) 

0  =s  Xjj  =s  u jj  V  (/,  j)  £  A'.  (2) 

Note  that  uts  is  effectively  infinite  since  the  maximum  flow 
cannot  exceed  u %  -  1. 

Lemma  1  regarding  MAXFLOW  follows  from  the  ob¬ 
servation  that  the  maximum  flow  through  a  network  can  be 
increased  by  at  most  one  unit  by  increasing  the  capacity  of 
an  arc  by  one  unit. 

Lemma  1.  The  dual  variables  associated  with  arc  capaci¬ 
ties  in  MAXFLOW  are  bounded  above  by  1. 

I  n  the  sections  that  follow,  we  will  use  the  following  theo¬ 
rem  to  establish  equivalence  of  alternative  formulations  of 
deterministic  and  stochastic  network  interdiction  models. 
The  set  of  arcs  A*  will  later  correspond  to  successfully 
interdicted  arcs. 
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Theorem  2.  Let  A*  c  A'.  Then,  z*  =  z **  where: 


z*  =  max 

X 


Dual  Vars. 


S.t.  E  Xij- 

-  E  Xji  =  o  viGW 

:tt,- 

C i.j)£FS(i ) 

(j,i)£RS(i) 

Xij^Ujj  V  (/,  V)  G  A  ' 

■aU 

X;7  <  0  V  (/,  y)  G  A  * 

Xij  >0  V  (/,  j)  G  A  ' 

'■Mu 

(3) 

and: 

z**  =  max  xts 

-  E  Xu  Dual  Vars. 

X 

( i,J)£A * 

S.t.  E  Xij 

E  Xji  =  o  viGiv 

:tt/ 

(. i.j)£FS(i ) 

(j,i)ERS(i) 

Xij^Uij  V  (/,  V)  G  A  ' 

:aij 

Xij  3=  0  V  (/,  y)  G  A  '. 

(4) 

Proof.  Let  [x*,  (w*,  a*,  p*)]  denote  an  optimal  primal 
and  dual  solution  to  (3)  with  dual  variables  corresponding 
to  constraints  as  noted.  It  suffices  to  show  that  [x**,  (tt**, 
a**)]  =  [x*,  (it*,  a*)]  is  an  optimal  solution  to  (4)  with 
objective  value  z*.  That  the  primal  and  dual  objective  val¬ 
ues  of  (4)  are  z*,  when  evaluated  at  x**  and  (tt**,  a**), 
can  be  seen  by  simple  substitution.  The  solution  x**  =  x* 
is  primal  feasible  to  (4)  since  the  primal  constraints  of  (3) 
are  a  restriction  of  those  of  (4).  Using  the  theorem  of 
strong  duality,  the  proof  will  be  complete  if  we  can  show 
dual  feasibility  of  (tt**,  a**)  in  (4).  The  dual  constraints 
associated  with  (/,  j)  &A'\A*  in  (4)  are  satisfied  by  (tt**, 
a**)  since  they  are  identical  to  those  in  (3).  The  remaining 
dual  constraints  of  (4),  which  are  tt,-  -  tt,-  +  a,j  3=  -1  for 
(/,;')  e  A*,  are  satisfied  since: 

TT*  -  TT*  +  cfij  +  >0  V  (/,  j)  &  A* 

by  dual  feasibility  of  (1), 

f  tt*  -  tt*  +  a*j  s*  s*  -1  V  (/',  j)  G  A  * 
by  rearranging  and  Lemma  1, 
f  TT  f  -  TT**  +  af  -1  V  (/,  j)  G  A  * 

by  substitution.  □ 


2.  THE  DETERMINISTIC  AND  STOCHASTIC 
MODELS 

This  section  reviews  the  basic  deterministic  network  inter¬ 
diction  model  and  then  describes  a  stochastic  variant, 
SN I  P(l  B ),  where  interdiction  successes  are  binary  random 
variables.  Lower  and  upper  bounds  on  the  optimal  objec¬ 
tive  value  of  the  stochastic  model  are  developed  in  subsec¬ 
tion  2.3  for  use  in  the  sequential  approximation  algorithm 
of  Section  3. 

2.1.  The  Deterministic  Model 

First  consider  the  basic,  deterministic  network  interdiction 
model  from  Wood  (1993).  This  model  assumes  that  an 


interdictor  has  R  total  units  of  resource  that  can  be  ex¬ 
pended  to  interdict  arcs  and  that  r,j  units  of  resource  are 
required  to  interdict  arc  (/,  j).  Let  y,7  be  a  binary  decision 
variable  that  is  1  if  arc  (/,  j)  is  interdicted  and  is  0  other¬ 
wise.  For  notational  simplicity,  let  yts  exist,  but  define  = 
R  +  1  so  that  the  return  arc  will  never  be  interdicted.  Also, 
let  T  =  {y\2j(i,ji<EA’rijyij  *=  e  {0.  1}  V  (h  j)  e  A'} 
and  let  x  G  X  denote  the  flow-balance  and  capacity  con¬ 
straints  of  M  AX  FLOW,  i.e.,  constraints  (1)  and  (2).  The 
deterministic  network  interdiction  problem  can  now  be  de¬ 
scribed  by  the  following  min-max  model: 

D-M  IN-MAX-1  z*  =  min  hd(y)  (Model  1) 

where: 

My)  =  max*ts, 

S.t.  0  =£  Xij  =£  U  ,j(l  ~  y,j)  V(/,7)  GA\ 

The  exact  form  of  r  is  unimportant  provided  that  its  con¬ 
straints  are  linear.  Flowever,  even  when  r,7  =  1  for  all  (i,j) 
G  A,  D-M  IN-MAX-1  is  an  NP-complete  problem  (Wood 
1993). 

We  may  reformulate  the  deterministic  network  interdic¬ 
tion  problem  as: 

D-M  IN-MAX-2  z*  =  min  gd(y)  (Model  2) 

7er 

where: 

9d(y)  —  max  xte  —  E  yljxlj. 

xeX  (i,j) £A ' 

A  pplying  Theorem  2  with  A*  =  {(/,y')|y;7  =  1},  we  see  that 
gd( y)  =  hd(y)  for  all  y  G  {0,  l}^'1.  Hence,  this  reformu¬ 
lation  is  equivalent  to  D-M  IN-M  AX-1  from  the  perspec¬ 
tive  of  determining  optimal  interdiction  decisions. 

2.2.  A  Stochastic  Model:  Uncertain  Interdiction 

Interdiction  of  an  arc  need  not  be  successful;  it  may  be 
completely  unsuccessful,  partially  successful  (part  of  the 
arc’s  capacity  is  destroyed)  or  completely  successful.  Ini¬ 
tially,  we  consider  the  binary  case  where  an  attempted 
interdiction  of  arc  (i,j)  is  completely  successful  with  prob¬ 
ability  Pij  and  is  completely  unsuccessful  with  probability 
1  -  pij.  I  ndependence  of  interdiction  successes  is  assumed, 
and  only  a  single  interdiction  may  be  attempted  on  any 
arc.  This  model  is  denoted  "SNIP(IB)." 

Let  7 jj  be  an  indicator  random  variable  that  is  1  with 
probability  p,7  and  is  0  with  probability  1  -  py.  The  state 
space;  i.e.,  support,  fori  is  denoted  3s  c  {0,  l}|/r|.  For  the 
case  of  binary  random  interdiction  successes,  the  following 
min-max  model  is  analogous  toD-MIN-MAX-l(M  odel  1) 
and  models  SN  I P ( I B ) : 

S-M  IN-M  AX-l(IB)  w*  =  min  Eh(y,  T)  (M  odel  3) 

7er 

where: 

h(  y,T)  =  maxxts, 

s.t.  0  x,j  as  Uij(  1  -  lijyu)  V  (/,  j)  G  A  '. 
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In  a  fashion  that  is  analogous  to  reformulating  D-M  IN¬ 
MAX-1  (Model  1)  as  D-M  IN-MAX -2  (Model  2),  we  refor¬ 
mulate  S-M  I N-M  AX -1(1  B)  as  follows: 

S-M  IN-M  AX-2(IB)  w*  =  min  Eg(y,  T)  (Model  4) 

y(=T 

where: 

g(y,  7)  =  max  xte  -  2  /yy-/*//- 

xeX  (i.j)eA' 

It  can  be  seen  that  g( y,  I)  =  h(y,  I)  for  all  (y,  I)  G  {0, 
l}'4'1  x  3  by  applying  Theorem  2  with  A*  =  {(/,  j)  G 
A'\yiL=  1,  /  jj  =  1}.  Thus,  the  recourse  functions  h(y,F)  and 
g(y,  I )  are  equivalent  and  this  reformulation  is  equivalent 
to  S-M  IN-M  AX-l(IB).  Again,  by  "equivalent"  we  mean 
that  the  first-stage  solution  sets  for  S-M  IN-M  AX -1(1  B) 
and  S-M  I  N-M  AX -2(1  B)  are  identical;  the  second-stage  so¬ 
lution  sets  may  differ. 

2.3.  Lower  and  Upper  Bounds  for  Uncertain 
Interdiction 

The  sequential  approximation  method  developed  in  Sec¬ 
tion  3  requires  lower  and  upper  bounds  on  w*,  which  we 
develop  here.  The  following  proposition  is  key  to  these 
bounds.  The  proposition  follows  from  standard  LP  theory, 
but  its  application  to  stochastic  programming  is  discussed 
in  Wets  (1966). 

Proposition  3.  For  fixed  y,  h(y,~l)  and  g{y,l)  are  concave 
and  convex  functions  on  the  convex  hull  of  3,  respectively. 

Asa  result,  we  may  applyj  ensen’s  inequality,  twice,  with 
Jj  =  El,]  to  obtain: 

g(y,~\)^Eg(y,~\)  =  Eh(y,~\)^h(y,  T). 

The  following  bounds  on  w*  may  be  formed  by  solving 
min7er9l(y'  0  to  obtain  y: 

g{ y,  F)  «  w*  h{ y,  F).  (5) 

In  Section  3,  we  will  refine  the  bounds  (5)  by  extending 
them  to  a  partition  of  the  state  space  of  the  indicator 
random  variables  (Huang  et  al.  1977).  Let  if  =  {31, 
32, . . . ,  3K}  he  such  a  partition  of  3\  i.e.,  Uk=ll3k  =  3  and 
3Jn3k  =  0  for  j  +  k.  The  elements  of  if  are  called  cells. 
A  Iso,  let  I ^  =  E (T|T  G  3k)  and  pk  =  Prob(\  G  3k).  Then,  a 
lower  bound  w(if)  on  w*,  with  respect  to  the  partition  if,  is 
derived  as  follows: 

K 

L BM  I N (if)  w*  =  min  2  PkE[g( y,  T ) [T  G  3k] 

VGT  k=1 
K 

ss  min  2  Pkg(y,  I k )  =  W.{if),  (M  odel  5) 

■yer  k=l 

where  "Model  5"  refers  to  the  minimization  problem  on 
the  right.  I  n  Section  3,  we  will  convert  this  min-max  model 
to  a  simple  minimization  model  and  it  will  become  appar¬ 
ent  that  the  number  of  rows  and  columns  in  the  problem  is 
proportional  to  \if\.  A  n  upper  bound  w(if,  y)  for  fixed  y  is 
obtained  using: 


K 

UB(EP,  y)  W*  =  2  pkE\h(y,  T)|T  G  3k] 

k=l 

K 

=£  2  Pkh( y,  I  k)  =  w(if,  y),  (M  odel  6) 

/c— 1 

where  "M  odel  6"  refers  to  the  |£P|  recourse  function  evalu¬ 
ations  (maximizations)  required  to  calculate  w[if,  y).  In 
the  algorithm,  we  apply  U  B(fT,  y)  to  the  optimal  decision 
y  obtained  in  calculating  LBM  IN(fT). 

A  refinement  of  a  partition  if  is  another  partition  if' 
such  that  for  any  3k'  G  if',  3k'  c  3k  for  some  3k  G  if  and 
3k'  G  3k  for  at  least  one  3k  G  if  and  3k'  G  if'.  L B - 
M  IN(fT)  and  U  B(fT,  y)  are  monotonic  in  the  sense  that  if 
if'  is  a  refinement  of  if: 

w(if)  «  w(if')  and  w(if,y)ssw(if',y). 

See  Hausch  and  Ziemba  (1983)  for  details. 

The  idea  behind  our  sequential  approximation  algo¬ 
rithm  is  to  create  a  sequence  of  finer  and  finer  partitions  if 
until  the  gap  between  lower  and  upper  bounds  is  suffi¬ 
ciently  small  and  we  can  declare  the  problem  solved,  at 
least  approximately.  We  recursively  refine  if  by  selecting 
one  of  its  cells  3k  and  subdividing  this  cell,  i.e.,  partitioning 
3k,  into  two  cells  3k'  and  3k",  and  then  replacing  3k  with 
3k'  and  3k"  to  obtain  the  refinement  if'.  The  algorithm  is 
convergent  since  our  refinement  scheme  could,  in  princi¬ 
ple,  create  a  partition  that  enumerates  3,  at  which  point 
LBM  IN (9")  (M  odel  5)  would  solve  SNIP(IB)  exactly.  Such 
an  algorithm  is  clearly  of  exponential  complexity  so,  for 
the  method  to  be  useful,  we  must  demonstrate  empirically 
that  if  does  not  grow  too  large  before  the  gap  between  the 
bounds  shrinks  sufficiently  to  yield  a  high-quality  solution. 

3.  SEQUENTIAL  APPROXIMATION  ALGORITHM 

In  this  section  we  describe  a  sequential  approximation  algo¬ 
rithm  for  solving  SN  IP(IB)  that  utilizes  the  bounds  developed 
in  the  previous  section.  The  algorithm  is  listed  in  Figure  2. 

3.1.  Overview  of  the  Algorithm 

At  each  iteration  of  the  algorithm  (starting  at  Step  1)  the 
partition  of  3  induces  an  approximating  problem  (M  odel 
5)  that  is  solved  to  calculate  LBMIN(Sf).  Model  5  is  an 
approximation  to  the  original  problem  in  the  following 
sense:  it  is  equivalent  to  M  odel  4  except  that!  is  replaced 
by  a  random  vector  with  fewer  realizations  (scenarios), 
namely,  I k,  k  =  1, . . . ,  K,  that  occur  with  probability  pk, 

k  =  1 . K.  This  min-max  K-scenario  stochastic  integer 

program  (Model  5)  can  be  solved  exactly  at  Step  1  using 
the  following  simple  minimization  model: 

K 

E-M  IN-2(IB)(£F)  w(if)  =  min  2  2  Pkaf]uij 

y.Ti.oi  k=1 

(M  odel  7) 

S.t.  77 i  -  71-/  +  afj  +  Jfjyij  ^  e,y  V  k,  (/,  j)  £  A', 
aljSsO  V  k,  (i ,  j)  £  A  ' ,  y  G  T, 
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Input:  A  problem  instance  for  SNIP(IB)  and  finite,  abso¬ 
lute  convergence  tolerance  e  >  0 
Output:  7*  approximately  solving  SNIP(IB),  and  lower 
bound  L*  and  upper  bound  U*  on  w*  such  that 
L*  =s  w*  =s  Eh(y*,~\)  «  U*  and  U*  -  L*  «  e; 

STEP  0.  Let  if  =  {$},  U*  =  +  °o  and  L  *  =  0; 

STEP  1.  Solve  LBM  IN  (£7)  for  7  and  let  L  *  =  w( £7); 

STEP  2.  If  (U*  -  L  *  =s  e)  then  go  to  (7). 

STEP  3.  Evaluate  U  B (f f,  7)  and  let  U'  =  t v(£7,  7); 

STEP  4.  If  (L/'  <  U*)  then  let  7*  =  7  and  let  U*  =  U'; 

STEP  5.  If  (U*  -  L*  =s  e)  then  go  to  (7); 

STEP  6.  Refine  the  partition  £7  and  go  to  (1); 

STEP  7.  Print  ("Approximate  solution  is",  7*); 

STEP  8.  Print  ("Lower  bound  =",  L*,  "Upper  bound 
=",  U*)  and  halt; 

Figure  2.  Sequential  approximation  algorithm  for  solving 
SNIP  (IB). 

where:  e,7  =  0  for  all  (/,  j)  #  (t,  s)  and  ets  =  1.  This  model 
can  be  derived  by  setting  up  LBM  IN (£7),  in  the  form  anal¬ 
ogous  to  S-M  I N-M  AX -2(1  B)  (Model  4),  and  taking  the 
duals  of  the  inner  maximizations. 

However,  as  the  number  of  scenarios  becomes  large, 
solving  E-M  IN-2(IB)(£7)  directly  can  become  difficult. 
Rather  than  doing  this,  we  solve,  or  approximately  solve, 
E-M  I N -2(1  B )(£7)  by  Benders  decomposition  (the  decom¬ 
position  can  also  be  derived  directly  from  the  min-max 
formulation  of  LBM  I N (£7)) .  The  decomposition  algorithm 
is  identical  to  the  continuous,  L-shaped  algorithm  of  Van 
Slyke  and  Wets  (1969),  except  that  the  master  problem  is 
subject  to  both  the  linear  and  binary  constraints  of  r.  (See 
Laporte  and  Louveaux  1993  and  Wollmer  1980  for  more 
complete  discussions  on  extensions  of  the  L-shaped 
method  to  stochastic  integer  programming.) 

One  advantage  of  using  the  decomposition  approach  is 
that  cuts  from  any  iteration  are  valid,  if  not  "tight,"  in 
subsequent  iterations  under  finer  partitions.  Thus,  the  final 
master  problem  in  iteration  n  of  the  algorithm  may  be 
used  as  the  starting  point  for  the  master  problem  in  itera¬ 
tion  n  +  1,  and  as  n  increases,  the  decompositions  tend  to 
converge  more  quickly  than  if  one  were  "starting  from 
scratch”  in  each  iteration.  Another  advantage  of  the  de¬ 
composition  is  that  we  need  not  solve  E -M  I N -2(1  B ) (£7) 
exactly.  At  each  iteration  of  the  Benders  decomposition, 
we  obtain  a  lower  bound  L"  and  an  upper  bound  U"  such 
that  L "  *s  L  *  =  w(£7)  U".  Thus,  we  can  stop  the  decom¬ 

position  when  L "  is  "good  enough"  and  use  L"  as  a  global 
lower  bound  in  place  of  L  *. 

I  n  Step  3,  we  evaluate  w(£7,  7)  (M  odel  6)  at  the  optimal 
solution  7  of  the  lower-bounding  problem  and,  if  appropri¬ 
ate,  update  the  best  upper  bound  observed  to  date.  How¬ 
ever,  it  might  be  advantageous  to  improve  the  upper 


bound  by  minimizing  t v(£7,  7)  subject  to  7  E  T.  W e  do  not 
pursue  this  idea,  but  we  note  that  it  is  possible  to  do  so 
since  this  min-max  problem  can  be  converted  to  a  minimi¬ 
zation  problem  using  the  transformations  exploited  by 
Wood  (1993)  for  the  deterministic  case. 

We  end  this  overview  by  noting  that  the  absolute  termi¬ 
nation  criterion  for  the  algorithm  is  tested  both  in  Steps  2 
and  5.  Of  course,  other  criteria  can  be  used  and,  in  prac¬ 
tice,  we  terminate  on  relative  error;  i.e.,  when  (upper 
bound  -  lower  bound)/(lower  bound)  is  sufficiently  small. 
The  remainder  of  this  section  focuses  on  the  approach  we 
use  to  refine  the  partition  in  Step  6. 

3.2.  Partitioning 

We  refine  the  partition  £7  by  selecting  a  cell  to  subdivide 
and  then  subdividing  that  cell  by  conditioning  on  whether 
or  not  a  potential  interdiction  is  successful.  Obviously,  the 
algorithm  slows  down  as  the  cardinality  of  the  partition 
increases,  so  we  must  reduce  the  optimality  gap  to  an 
acceptable  level  before  K  =  |£7|  becomes  too  large.  Two 
heuristics  are  described  here  that  tend  to  reduce  the  gap 
quickly  by  (a)  selecting  a  "good"  cell  to  subdivide  and  (b) 
subdividing  the  cell  effectively.  See  Birge  and  Wets  (1986), 
Frauendorfer  (1992,  §  19),  and  Kail  et  al.  (1988)  for  re¬ 
lated  discussions. 

3.2.1.  Selecting  a  cell  to  subdivide.  The  gap  between  the 
upper  and  lower  bounds  may  be  expressed: 

< 

w(£7,  7)  -  w(£7)  =  2  Pk[h( 7,  I*)  -  g(y,  I*)], 

k=  1 

and  hence,  the  difference  due  to  each  cell  is: 

D  k(y)  =  pk[h(y,  P)  —  g(y,  P)].  (6) 

We  will  select  a  cell  k'  to  subdivide  such  that  k'  E 
argmax^D^-y)},  although  other  selection  criteria  could  be 
used.  It  is  important  to  note  that  (6)  depends  on  7,  and 
Dk(  )  should  be  re-evaluated  for  all  cells  when  7  has 
changed  from  the  previous  iteration.  In  subsection  5.2  we 
describe  a  computational  enhancement  that  significantly 
increases  solution  speed  by  performing  a  sequence  of  cell 
refinements  prior  to  re-solving  the  lower-bounding  prob¬ 
lem  to  obtain  a  new  7.  Next,  we  need  to  decide  how  to 
partition  cell  k. 

3.2.2.  Subdividing  on  arcs.  In  rectangular  partitioning 
schemes,  cells  are  recursively  subdivided  by  planes  orthog¬ 
onal  to  the  axis  of  one  stochastic  parameter.  In  our  case, 
this  corresponds  to  selecting  some  cell  $k  together  with  an 
arc  (/',  _/')  such  that  lrj,  is  not  fixed  in  3k,  and  conditioning 
on  whether lr],  =  0  or 7 r],  =  1.  A  generic  cell  3>k  of  £7  has 
the  form  n()  y)eE/A  {/,y|//7  =  ajj,  bk}  where  the  possible  values 
for  the  pair  (ak,  bty  indicate  whether/^  on  $k  is:  fixed  at  0, 
(0,  0),  fixed  at  1,  (1,  1),  or  not  fixed,  (0,  1).  Subdivision  of  a 
cell  $k  with  respect  to  arc  (/',  j'),  satisfying  (afr,  bkr)  = 
(0,  1),  corresponds  to  replacing  $k  with  two  disjoint  cells 
$k'  and  satisfying: 
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(a, 7',  bjj)  =  (a If,  /by") 

=  (afj,b!j)  V(/,j)eA'\{(/',j')}, 
and 

(a,y,  b/7<)  =  (0,  0)  and  (a/£,  bfy)  =  (1,  1). 

Conditional  probabilities  and  expectations  are  easy  to  cal¬ 
culate: 


pk  =  Prob(!  E#11) 

=  f  El  P/A  •  (  n  a 

\  {(i,])EA'\a$=blj=l}  /  \  {(IJ)eA'ja(=b(=0} 


ifj  =  e  (T|T  g  # k ) 


f  0  if  (a /y,  bfj)  =  (0,  0), 

1  if  (ajj,  bfj)  =  (1,  1), 

if  (ajj,  bfj)  =  (0,  1). 


Our  method  for  selecting  an  arc  for  conditioning  is  de¬ 
scribed  next,  assuming  that  cell  3>k  has  already  been  se¬ 
lected  for  subdivision.  For  each  arc  (i,  j)  satisfying  (ay,  by) 
=  (0,  1),  we  form  3k'  and  $k"  as  described  above  and 
calculate  the  deviation  in  bounds  Dk'(y)  +  Dk”(7)  (which 
is  guaranteed  to  be  no  larger  than  Dk(y)).  We  select  an  arc 
to  subdivide  that  minimizes  Dk'(y)  +  Dk"(-y).  We 
must  solve  four  recourse  problems  for  each  candidate  arc 
on  which  we  consider  conditioning.  Note  that  such  a  rule 
would  be  considerably  more  expensive  to  implement  when 
using  the  E  dmundson-M  adansky  bound. 

I  n  the  SN I P ( I B )  model,  we  can  reduce  the  set  of  arcs  to 
which  we  apply  the  above  rule  by  never  subdividing  on  an 
arc  (/,  j)  that  currently  has  yy  =  0.  Clearly,  the  algorithm 
still  converges  under  this  rule  because  a  stochastic  param¬ 
eter  Ijj  cannot  contribute  to  the  error  unless  y,s  =  1. 

Selecting  an  arc  that  minimizes  Dk'(y)  +  D k  (-y)  puts 
equal  value  on  decreasing  the  upper  bound  or  increasing 
the  lower  bound.  This  rule  can  be  modified  by  putting  a 
greater  weight  on  the  improvement  in  the  lower  bound, 
with  the  idea  that  it  is  more  important  to  get  a  high  quality 
lower-bounding  approximation  problem  since  it  deter¬ 
mines  the  incumbent  solution. 


4.  EXTENSIONS 

This  section  first  considers  an  extension  of  SNIP(IB),  de¬ 
noted  "SN  I  P( I C B ),"  where  arc  capacities  as  well  as  inter¬ 
diction  successes  are  binary  random  variables.  Asa  special 
case,  we  immediately  obtain  SNIP(CB),  which  only  has 
uncertain  binary  capacities,  by  setting  the  probabilities  of 
successful  interdictions  in  SNIP(ICB)  to  1.  We  then  extend 
SNIP(CB)  to  SNIP(CD)  where  capacity  can  take  on  a  fi¬ 
nite  number  of  realizations.  Finally,  we  consider  SN  I  P(  I M  ) 
where  multiple  interdiction  attempts  on  a  single  arc  are 
allowed.  Such  a  model  would  be  useful  when  the  probabil¬ 
ity  of  a  successful  interdiction  is  relatively  low  and/or  when 
interdiction  success  on  a  particular  arc  or  group  of  arcs  is 
critical  to  reducing  flow. 


4.1.  Uncertain  Binary  Interdictions  and  Arc 
Capacities,  SNIP(ICB) 

Consider  the  model  SNIP(ICB)  where  (a)  at  most  one 
interdiction  on  an  arc  may  be  attempted,  (b)  interdiction 
successes  are  binary  random  variables  as  in  SNIP(IB),  (c) 
the  capacity  of  each  arc  (/,  j)  is  a  binary  random  variable 
that  can  take  on  the  values  0  or  Uy,  and  (d)  all  random 
variables  are  independent.  (Modifications  for  nonzero 
minimum  capacities  are  easily  handled.)  Define  the  indica¬ 
tor  random  variable 7y  to  be  1  if  arc  (/,  j)  exists  and  has 
capacity  u,7,  and  to  be  0  if  it  does  not  exist  (or  it  exists  but 
has  no  capacity).  Also,  let  <#>y  =  Prob(Jy  =  1);  definitions 
related  to  uncertain  interdictions  remain  as  before.  The 
analogs  of  S-M  I N  -M  AX -1(1  B)  (Model  3)  and  S-M  IN¬ 
MAX -2(1  B)  (Model  4)  are: 

S-M  IN-M  AX-l(ICB)  w*  =  min  Eh(y,  T,  J~) 

7er 

(M  odel  8) 

where: 

h(y,  T,  J )  =  max  xte, 

S.t.  0  «  Xy  as  Uijdij  ~  7y/y7y)  V  (/,/)  G  A 

and: 

S-M  IN-M  AX-2(ICB)  w *  =  min  Eg(y,  I,  J~) 

Y^r 

(M  odel  9) 

where: 

Q(y,  T.  J  )  =  maxxts  -  2  (1  -Jy  +  7yJy7y)Xy. 

xeX  (iJ)eA ' 

In  the  "natural  formulation"  S-M  IN-M  AX-l(ICB),  an 
arc  (/,  j)  has  its  nominal  capacity  dropped  to  zero  if  it  does 
not  exist,  i.e.,  if  Jy  =  0;  or  if  the  arc  is  successfully  inter¬ 
dicted,  i.e.,  if  7y7y  =  1.  In  the  equivalent  model  S-M  I N - 
M  A  X  -2( I C B ) ,  we  subtract  any  flow  Xy  from  the  total  flow 
if  either  of  the  above  conditions  hold.  The  correctness  of 
the  alternative  formulation  follows  from  Theorem  2.  The 
development  of  bounds  and  an  algorithm  for  SNIP(ICB) 
parallels  the  development  for  SNIP(IB)  and  is  omitted. 
We  remark  only  that  the  models  may  be  transformed  to  a 
more  standard  form  by  viewing  the  random  parameters  as 

independent  vectors  of  the  form  (  ~  )  with  realizations 

(i),  (o),  (o)  ar|d  respective  probabilities  </jyPy,  </>y(l  - 
Pij),  and  1  -  4>ij.  Finally,  note  that  SNIP(CB)  (interdictions 
are  certain  but  arc  capacities  are  binary  random  variables) 
isthe  special  case  of  SNIP(ICB)  with  Prob(7y  =  1)  =  1  for 
all  (/,  j)  G  A'. 

4.2.  Discrete  Random  Arc  Capacities,  SNIP(CD) 

We  now  generalize  our  models  to  handle  random  arc  ca¬ 
pacities  that  have  a  finite  number  of  realizations.  For  no- 
tational  simplicity  and  without  loss  of  generality,  we 
assume  interdiction  success  is  certain.  This  model  is  de¬ 
noted  "SNIP(CD)."  Let  u  be  the  nonnegative  random 


vector  of  arc  capacities.  Then  the  following  model  leads  to 
upper  bounds  for  SNIP(CD): 

S-M  IN-M  AX-l(CG)  w*  =  min  Eh(y,  u) 

y(=T 

where: 

h(y,  u)  =  max  xts, 

xeX 

s.t.  0  ssx/y  =£  Uij(l  -  yij)  V  (/ ,  j)  e.  A' . 

For  fixed  y,  S-M  I N-M  AX-1(CG )  is  a  stochastic  maximum 
flow  problem,  and  when  u  is  replaced  by  □,  we  obtain  the 
standard  J  ensen  upper  bound  for  this  problem.  The  bound 
holds  for  more  general  nonnegative  distributions  in  which 
the  relevant  expectations  are  finite.  See  Aneja  and  Nair 
(1980),  Carey  and  Hendrickson  (1984),  and  Wallace 
(1987a)  for  related  methods  for  bounding  the  expected 
maximum  flow  in  stochastic  networks,  i.e.,  bounding 
Eh( 0,  u). 

In  order  to  develop  the  lower  bound,  assume  that  each 
arc  (/,  j)  can  take  on  L  different  capacity  values  u, such 
that  Ujji  =s  Ujji+1  for  /  =  1, .  . . ,  L  -  1.  Let  the  "/th 
capacity  increment"  for  arc  (/,  j)  be  ufj,,  i.e^,  ufj;  =  utjl  - 
uiji_1  for  /  =  2, .../.,  and  ufjt  =  u,7/.  Let  J/y/  be  the  in¬ 
dicator  random  variable  that  is  1  if  u/y-  >  t/y/,  and  is  0 
otherwise.  For  notational  simplicity,  assume  that  the  re¬ 
turn  arc  also  has  L  ^capacity  values,  but  that  utsL  is  effec¬ 
tively  infinite  and  ]tsL  =  1.  Then  S-M  IN-M  AX-l(CG) 
specializes  to: 

S-M  IN-M  AX-l(CD)  w*  =  min  Eh'(y,  J) 

Y6r 

where: 

L 

h'(y,  J)  =  max  2  xts, 

»  1=1 

s.t.  2  2%  -  2  2  XjH  =  o  v/gw, 

(i.j)EFS(i)  1=  1  (j.i)ERS(i)  1=1 

o  =s  Xjjl  u  IjJ  jji  ( 1  -  yij)  V(i,j)6AM  =  1 . L. 

This  model  replaces  each  original  arc  with  L  parallel 
arcs  in  order  to  use  the  indicator  random  variables 
Jiji  rather  than  the  original  random  variables  u,7.  For 

each  arc  (/',  j),  the  random  variables  Jy,  for  /  =  1 . L 

are  dependent,  but  this  does  not  compromise  the 
validity  of  the  bound  since  Jensen’s  inequality  does 
not  require  independence  of  the  relevant  random 
variables. 

Given  that  we  have  represented  S-M  IN-M  AX-l(CD)  as 
a  variant  of  the  binary  model  S-M  I  N-M  AX -1(1  CB)  (M  odel 
8)  with  Ijj  =  1,  we  can  now  write  the  corresponding  variant 
of  S-M  IN-M  A  X -2(1  C  B )  (Model  9): 

S-M  IN-M  AX-2(CD)  w*  =  min  E  g(y,  J~) 
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L  L 

g(y,  J~)  =  max  2  Xts/  -  2  2  (1  -  ] iji  +  ] iji  y ,y)xy, 

x  1  =  1  (i.j)EA’  1  =  1 

s.t.  2  2  %-  2  E%=oview, 

(i.j)EFS(i)  1=1  (j.i)ERS(i)  1=1 

0  Xyi  ^  ufji  V  (/, ;)  E  A  ',  /  =  1 . L. 

As  in  SNIP(IB)  and  SNIP(ICB),  conditional  expecta¬ 
tions  of  g(y,  J)  and  h[y,  u)  with  respect  to  partitions  of 
the  associated  state  spaces  lead  to  lower  and  upper 
bounds,  respectively.  Partitioning  schemes  can  be  extended 
to  discrete  random  arc  capacities  by  conditioning  on 
whether  the  capacity  value  is  at  or  below  a  certain  level  or 
above  the  specified  level. 

4.3.  Multiple  Uncertain  Interdiction  Attempts, 
SNIP(IM) 

When  interdiction  success  probabilities  are  low,  or  when 
certain  arcs  are  critical  to  maximizing  flow,  it  may  be  de¬ 
sirable  to  make  more  than  one  attempt  at  interdicting  cer¬ 
tain  arcs.  We  model  this  situation  with  "SNIP(IM).”  This 
model  assumes  that  the  successes  of  interdiction  attempts 
are  independent  and  that  no  intelligence  about  the  success 
or  failure  of  an  interdiction  attempt  can  be  gathered  until 
all  attempts  are  made.  (A  multistage  stochastic  program¬ 
ming  model  would  be  needed  if  the  state  of  the  network 
could  be  observed  after  each  interdiction  attempt,  or 
group  of  attempts,  and  these  observations  could  influence 
subsequent  attempts.)  For  notational  and  expository  sim¬ 
plicity,  we  describe  the  modeling  extensions  for  the  special 
case  in  which  an  interdiction  on  any  arc  (/,  j)  may  be 
attempted  at  most  twice.  Let  lin  and  ljj2  be  the  indicator 
random  variables  for  the  success  of  the  first  and  second 
interdiction  attempts,  respectively,  with  associated  success 
probabilities  p/yi  and  pjj2. 

There  are  several  ways  to  formulate  models  for 
SN I P ( I M  ),  but  we  have  chosen  the  following  for  its  ease  of 
implementation.  Let  y^  be  the  first-stage  decision  variable 
that  is  1  if  at  least  one  interdiction  attempt  is  made  on  arc 
(/,  j)  (0  otherwise),  and  let  y,j2  be  1  if  two  attempts  are 
made  (0  otherwise).  Thus,  yin  =  1  and  yij2  =  0  when 
exactly  one  interdiction  attempt  is  made.  In  our  formula¬ 
tion,  we  must  add  constraints  requiring  that  the  "first  at¬ 
tempt"  be  made  before  the  second.  Therefore,  we  define: 

r'  =  |  y\yiji,  y,j2  e  {0,  1}, 

yiji  ~  yij2  5®  0,  2  2  rijkyijk  R 1,  (7) 

(i.j)EA'  k= 1  J 

where  rjjk  units  of  resource  are  required  for  the  kth  inter¬ 
diction  attempt  on  arc  (/,  j).  The  equivalent  formulations 
for  this  problem  are: 

S-M  IN-M  AX-1(IM  )  w*  =  min  Eh(y,  T) 


where: 


where: 
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Table  I 

Test  Problem  Characteristics 


Problem 

First  Stage 
(rows  x  cols.) 

Subproblem 
(nodes  x  arcs) 

N  umber  of  Stochastic 
Parameters 

Number  of  Scenarios 

SN  1  P(  1 B ).7  X  5 

1  x  22 

37  x  61 

22 

4.2  x  106 

SN  1  P(  1 C  B ) .7  X  5 

1  x  22 

37  x  61 

44 

3.1  x  1010 

SN  1  P(l B ).4  X  9 

1  x  24 

38  x  70 

24 

1.7  x  107 

SN  1  P(  1 C  B ) .4  X  9 

1  x  24 

38  x  70 

48 

2.8  x  1011 

SN  1  P(  1 B ) .10  X  10 

1  x  84 

102  x  183 

84 

1.9  x  1025 

SN  1  P(  1 C  B )  .10  X  10 

1  x  84 

102  x  183 

168 

1.2  x  1040 

h(y,  T)  =  max  xts, 
s.t.  0 

'  (1  “  CjlTyl  —  (1  V  (i,J)  £  A  ', 

and: 

S-M  I  N -M  AX-2(IM  )  w*  =  min  Eg(y,  T) 

7GT' 

where: 

g(7,  I)  =  max xti  -  2  (7;/iy;/i  +  (1  - 1  ijiV 

xeX  (i.i)eA' 

Devising  a  recursive  partitioning  scheme  to  exploit  these 
formulations  is  straightforward  if  we  condition  first  on 
whether  or  not  7,yi  =  1  and  only  when  7/;1  =  0,  condition 
on  whether  or  not lij2  =  1.  As  in  subsection  4.1,  implemen¬ 
tation  can  be  facilitated  by  transforming  the  random  pa¬ 
rameters  into  more  standard,  independent  vectors  of  the 

form  ^(i_7^7f.2j  with  realizations  (o)<  (i).  (o)  anc*  respec¬ 
tive  probabilities  (1  -  pin)(  1  -  piJ2),  (1  -  p,71)p;y2,  and 
Piji- 

5.  COMPUTATIONAL  RESULTS 

The  algorithm  described  in  Section  3  has  been  imple¬ 
mented  and  tested  on  the  set  of  stochastic  network  inter¬ 
diction  problems  described  here.  We  begin  by  giving  an 
overview  of  the  implementation  and  the  test  problems. 
Then,  two  examples  are  used  to  illustrate  the  value  of  the 
stochastic  solution  for  the  binary  interdiction  problem 
SNIP(IB).  Computational  results  are  then  summarized  for 
some  modest-sized  model  instances  that  also  include  binary 
random  arc  capacities  (SNIP(ICB)).  We  also  illustrate  how 
computational  difficulty  varies  with  certain  model  parameters 
including  the  size  of  the  interdiction  resource  budget  and  the 
values  of  the  arc  existence  probabilities.  Finally,  we  de¬ 
scribe  computational  experience  on  a  larger  network  model. 

The  algorithm  is  coded  in  FORTRAN  and  uses  IBM 's 
Optimization  Subroutine  Library  (OSL)  (1991)  to  solve 
the  integer  master  problems  and  linear  subproblems.  The 
code  is  adapted  from  an  implementation  (Morton  1995) 
designed  to  handle  general  LP  subproblems  in  which  the 
data  are  read  in  SM  PS  format  (Birge  et  al.  1987)  and 
first-stage  decisions  are  passed  to  the  right-hand  side  of 
the  second-stage  constraints.  Because  the  code  was  not 
originally  designed  to  solve  network  interdiction  problems, 


it  does  not  exploit  many  special  structures  that  could  im¬ 
prove  its  efficiency.  Several  examples  are  (a)  the  network 
flow  subproblems  are  solved  by  a  general  LP  optimizer 
rather  than  a  more  efficient  network  optimizer;  (b)  the 
dual  of  the  lower-bounding  subproblem  (see  S-M  IN¬ 
MAX  -2(1  B),  M  odel  4)  is  solved,  rather  than  the  primal,  in 
order  to  accommodate  decisions  being  passed  to  the  right- 
hand  side  instead  of  the  objective;  and  (c)  bounds  on  vari¬ 
ables  in  the  upper-bounding  subproblems  are  implemented 
as  structural  constraints  rather  than  as  simple  upper  bounds. 
So,  this  code  is  prototypic,  but  it  still  effectively  illustrates 
the  value  of  the  proposed  methodology.  All  CPU  times 
reported  here  are  from  an  IBM  R S/6000  Model  590  with 
512  megabytes  of  random  access  memory. 

The  test  problems  are  summarized  in  Table  I. 
SNIP(P).a  x  b  denotes  a  SNIP  problem  of  type  P  on  a 
network  with  an  a  x  b  rectangular  grid  of  nodes,  i.e.,  with 
a  horizontal  layers  of  b  nodes  each.  H  orizontal  arcs  are 
oriented  from  "west  to  east"  but  vertical  arcs  are  oriented 
randomly.  There  are  no  arcs  in  parallel  or  anti-parallel.  All 
westernmost  nodes  are  connected  to  a  supersource  with  arti¬ 
ficial,  noninterdictable,  infinite-capacity  arcs  and  all  eastern¬ 
most  nodes  are  connected  to  a  supersink  with  artificial, 
noninterdictable,  infinite-capacity  arcs.  (Because  of  this  struc¬ 
ture,  the  easternmost  vertical  arcs  are  superfluous  and  are 
not  considered  as  interdictable.)  The  node  and  arc  data  in 
Table  I  counts  the  supersource,  supersink  and  artificial  arcs. 
Figures  3  and  4  show  SNIP(IB).4  x  9  and  SNIP(IB).7  x  5. 

For  each  problem,  only  a  subset  of  the  network’s  arcs 
involve  uncertainty.  For  example,  the  SN I P ( I B ) .7  x  5  net¬ 
work  contains  37  nodes  and  61  arcs  (including  the  artificial 
nodes  and  arcs),  but  only  22  of  the  original  arcs  are  eligible 
for  interdiction.  In  the  SN  I P  ( I C  B )  .7  x  5  example,  those 
same  22  arcs  have  both  uncertain  interdiction  success  and 
uncertain  capacity  while  other  arcs  are  noninterdictable 
and  have  deterministic  capacities.  As  described  in  subsec¬ 
tion  4.1,  the  SNIP(ICB)  models  implement  stochastic  arc 
existence  combined  with  stochastic  interdiction  success  as 
sets  of  independent  random  2-vectors  with  three  realiza¬ 
tions  each.  All  p,7  values  (interdiction  success  probabilities) 
are  identical  for  each  interdictable  arc  in  any  test  problem, 
as  are  the  <f>,7  values  (arc  existence  probabilities)  in  the 
SNIP(ICB)  examples.  For  simplicity,  r,7  =  1  for  all  prob¬ 
lems;  i.e.,  one  unit  of  resource  is  required  to  interdict  each 
interdictable  arc. 
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Figure 3.  Sequential  Approximation  Algorithm  for  Solving  SNIP(IB) 


The  number  of  scenarios  and/or  stochastic  parameters  is 
not  always  a  good  measure  of  the  difficulty  of  a  stochastic 
program.  The  values  in  Table  I  should  be  read  with  the 
following  in  mind:  given  a  fixed  first-stage  decision,  evalu¬ 
ating  the  recourse  function  for  SNIP(ICB)  requires  deal¬ 
ing  with  one  or  two  stochastic  parameters  for  each 
interdictable  arc,  in  particular,  the  arc-existence  parameter 
and  possibly  the  interdiction  parameter  if  the  first-stage 
decision  interdicts  the  arc.  However,  for  SNIP(IB),  this 
evaluation  only  involves  a  subset  of  the  stochastic  interdic¬ 
tion  parameters  due  the  integral  first-stage  decision  y.  So, 
the  number  of  stochastic  interdiction  parameters  that  is 
"active"  at  any  one  time  corresponds  to  the  budget  avail¬ 
able,  rather  than  the  total  number  of  stochastic  parame¬ 
ters.  On  the  other  hand,  SNIP(IB)  with  100ft  arcs,  all 
interdictable,  and  an  interdiction  budget  of  ft,  is  certainly 
harder  to  solve  than  a  simple  stochastic  maximum  flow 


Figured  SN I P ( I B ) .7  x  5  example.  Node  s  is  the  super¬ 
source  and  node  t  the  supersink.  Arcs  are  la¬ 
beled  with  their  capacities  and  only  arcs  with 
bars  over  their  capacities  are  interdictable. 


problem  with  99ft  deterministic  arcs  and  ft  stochastic  arcs, 
because  the  interdiction  problem  must  decide  where  to 
"place  the  uncertainty." 

In  contrast  to  interdiction  uncertainties,  random  arc  ex¬ 
istence  parameters  in  SNIP(ICB)  do  not  depend  on  y  and 
hence  are  always  active. 

5.1.  Value  of  the  Stochastic  Solution 

T able  I  indicates  that  the  deterministic  equivalents  of  our 
stochastic  programming  problems  can  be  very  large.  This  is 
typical  of  stochastic  programs,  and  so,  such  problems  are 
often  approximately  solved  by  solving  expected-value  mod¬ 
els  in  which  random  parameters  are  replaced  with  their 
means.  That  this  can  lead  to  poor  decisions  has  been  dem¬ 
onstrated  in  the  introduction.  However,  more  can  be 
learned  about  the  pitfalls  of  the  expected-value  approach 
by  investigating  the  differences  in  the  expected -value  solu¬ 
tion  and  the  true  solution  for  more  realistically  sized  exam¬ 
ples.  W  e  perform  this  investigation  here  with  two  examples 
of  SNIP(IB).  All  solution  values  we  report  in  this  section 
are  computed  with  a  relative  error  of  no  more  than  0.01, 
where  relative  error  is  defined  as  (upper  bound-lower 
bound)/(lower  bound). 

To  perform  this  analysis,  we  first  solve  the  expected- 
value  model  of  the  "natural  formulation"  S-MIN-MAX- 
1(1  B)  (M  odel  3),  and  denote  the  optimal  solution  yEV.  The 
performance  of  yEV  is  then  evaluated  in  the  stochastic 
environment;  i.e.,  we  calculate  Eh(yEV,  T).  This  objective 
value  can  be  compared  with  the  optimal  objective  Eh(y*, 
T);  the  difference  between  these  values  is  referred  to  as 
“the  value  of  the  stochastic  solution"  (Birge  1982). 

We  begin  with  SN  I P ( I B ) .4  x  9  with  an  interdiction  bud¬ 
get  of  ft  =  6  and  p,7  =  0.75  for  all  interdictable  arcs.  (See 
Figure  3.)  In  the  expected-value  problem,  the  minimum 
capacity  cut  consists  of  four  interdicted  arcs,  arcs  (17,  21), 
(22,  26),  (31,  35)  and  (32,  36).  When  the  budget  resource 
constraint  is  implemented  as  an  inequality,  only  these  four 
arcs  are  interdicted  in  our  solution,  even  though  there  is 
an  interdiction  budget  of  six.  For  this  model  we  obtain, 
Eh( yEV,  T)  =  25.0  while  Eh( y*,  T)  =  10.9.  That  is,  the 
stochastic  solution  improves  the  stochastic  objective  by 
more  than  a  factor  of  two.  When  the  budget  constraint  is 
implemented  as  an  equality,  two  additional  arcs  (arcs  (12, 
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Table  II 

Relative  E rrors  vs.  CPU  Time  for  SN I  P(l B).7  x  5  with  p,7  =  0.75  and  ft  =  6, 
and  for  SN  I P ( I C  B )  .7  x  5  with  p;7  =  0.75,  c f>,7  =  0.9,  and  R  =  6 


N umber  of  Cells 

SN  1  P ( 1 B )  .7  X  5 
Relative  Error 

Cumulative  CPU  sec. 

N  umber  of  Cells 

SN  1  P(  1 C  B ) .7  X  5 
Relative  Error 

Cumulative  CPU  sec. 

(Local) 

(Global) 

(Local) 

(G  lobal) 

1 

0.42 

1.1 

1 

0.95 

1.5 

2 

0.17 

0.17 

2.5 

12 

0.43 

0.64 

6.3 

4 

0.058 

0.11 

7.3 

20 

0.30 

0.34 

21.3 

7 

0.046 

0.058 

11.8 

55 

0.17 

0.22 

46.0 

10 

0.022 

0.037 

17.8 

126 

0.11 

0.11 

104.9 

12 

0.017 

0.017 

20.3 

327 

0.055 

0.068 

228.9 

14 

0.0052 

0.0052 

29.2 

742 

0.034 

0.038 

433.1 

1648 

0.019 

0.019 

848.0 

3735 

0.0099 

0.0099 

1532.4 

16)  and  (31,  32))  are  interdicted  in  the  expected-value 
problem,  but  poor  choices  are  made  by  the  model  and  we 
still  obtain  Eh(yEV,  T)  =  25.0.  The  stochastic  solution  se¬ 
lects  the  same  four  arcs  as  the  expected-value  model,  but 
an  intelligent  choice  of  the  additional  two  arcs  (arcs  (5,  9) 
and  (10,  14))  significantly  improves  the  quality  of  the  solu¬ 
tion.  So,  in  this  example,  one  of  the  expected-value  solu¬ 
tions  is  an  optimal  stochastic  solution,  but  the  expected- 
value  model  has  no  way  of  differentiating  among  its 
alternatives  and  chooses  a  wrong  one. 

The  second  example,  shown  in  Figure  4,  is 
SN  I P  ( I B )  .7  x  5.  Once  again,  we  use  an  interdiction  budget 
of  ft  =  6  and  p,7  =  0.75  for  all  interdictable  arcs.  In  this 
model,  the  budget  and  problem  structure  allow  the 
expected-value  model  to  interdict  only  a  subset  of  the  arcs 
on  a  minimum  capacity  cut.  U  nlike  the  previous  example, 
the  expected  value  and  stochastic  solutions  share  only  two 
arcs  in  common.  (The  expected-value  solution  interdicts 
arcs  (12,  19),  (13,  20),  (17,  24),  (18,  25),  (22,  29),  and  (23, 
30).  The  stochastic  solution  interdicts  arcs  (6,  13),  (7,  14), 
(17,  16),  (17,  24),  (18,  25),  and  (23,  22)).  In  fact,  the  total 
nominal  capacity  of  interdicted  arcs  in  the  expected-value 
solution  is  290  while  the  corresponding  capacity  for  the 
stochastic  solution  is  230.  The  stochastic  program  sacrifices 
60  units  of  nominal  capacity  in  order  to  improve  the  solu¬ 
tion.  For  this  model,  Eh(yEV,l)  =  119.6  while  Eh(y*,  T)  = 
80.4. 

5.2.  Small  Test  Problems  and  Computational 
Enhancements 

As  noted  in  subsection  3.2.1,  every  time  the  first-stage  de¬ 
cision  changes,  the  J  ensen  bounds  on  each  cell  of  the  par¬ 
tition  must  be  reevaluated.  However,  solution  speed  can 
be  increased  significantly  by  performing  a  number  of  cell 
refinements  prior  to  re-solving  the  lower-bounding  prob¬ 
lem.  This  idea  is  implemented  as  follows:  After  having 
performed  Steps  1  and  3  of  the  algorithm  (see  F  igure  2),  a 
relative  error  is  calculated  from  the  global  upper  and 
lower  bounds  associated  with  the  current  solution  7.  We 
then  refine  the  partition  with  respect  to  the  fixed  7  until 
the  local  relative  error  is  cut  in  half.  Note  that  during  this 


procedure,  the  recourse  function  need  only  be  evaluated 
on  new  cells.  We  then  perform  the  next  iteration  of  the 
algorithm.  The  upper  bound  produced  for  fixed  7  is  glo¬ 
bally  valid  but  a  global  lower  bound  is  obtained  only  by 
reoptimizing  the  lower-bounding  problem. 

T ables  1 1  and  1 1 1  display  local  and  global  relative  errors 
as  the  algorithm  converges  for  four  test  problems.  They 
also  reveal  a  number  of  interesting  features  regarding  the 
problems,  bounds,  and  algorithm.  The  initial  Jensen 
bounds  are  considerably  worse  for  the  "longer”  4x9 
network  than  for  the  7  x  5  network.  This  is  consistent  with 
the  presence  of  redundant  penalty  terms  in  the  lower- 
bounding  objective.  For  instance,  consider  the  initial 
lower-bounding  problem  for  SNIP(IB).  If  flow  moves 
along  a  path  with  two  interdicted  arcs  (i,  j)  and  (/',;')  in 
this  model,  a  penalty  of  p,7  +  p,r  is  subtracted  in  the 
objective  of  the  recourse  function.  H  owever,  this  flow  will 
be  stopped  if  either  interdiction  is  successful  and  the  pen¬ 
alty  should  only  be  p,7  +  pVj,  -  p,7p/7..  One  may  be  able  to 
reduce  this  effect  by  using  a  path  (or  partial-path)  formu¬ 
lation  of  the  model  (Aneja  and  Nair  1980). 

The  results  indicate  that  the  higher  dimensionality  intro¬ 
duced  by  including  random  arc  capacities  makes  computa¬ 
tion  significantly  more  expensive.  The  tables  display 
relative  errors  associated  with  the  current  solution  7,  in 
order  to  convey  some  of  the  volatility  of  the  quality  of  the 
decisions  generated  by  the  sequence  of  lower-bounding 
problems.  I  n  particular,  see  T able  III  for  the  4  x  9  prob¬ 
lems.  The  global  relative  error  is  typically  larger  than  the 
local  error  for  the  same  partition  (because  the  global  lower 
bound  is  no  larger  than  the  local  lower  bound).  However, 
within  the  local/global  refinement  procedure,  the  lower- 
bounding  problem  occasionally  generates  a  new  first-stage 
decision  that  significantly  improves  the  upper  bound  and 
the  reverse  occurs.  For  example,  see  the  sixth  row  of  the 
results  for  SN  I  P(l  C B ).4  x  9. 

To  illustrate  the  value  of  the  local/global  refinement 
procedure  over  naive  refinement,  we  performed  experi¬ 
ments  in  which  the  lower-bounding  problem  is  reoptimized 
every  time  a  cell  is  subdivided.  For  this  strategy, 
SN  I P ( I B ) .7  x  5  requires  12  cells  and  53.5  seconds,  while 
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Table  III 

Relative  E rrors  vs.  CPU  Time  for  SN I  P(l B).4  x  9  with  p,y  =  0.75,  R  =  6, 
and  SN  I P ( I C  B )  .4  x  9  with  p/y  =  0.75,  <f>  =  0.9,  and  R  =  6 


N umber  of  Cells 

SN  1  P(l B ).4  X  9 
Relative  Error 

Cumulative  CPU  Sec. 

N  umber  of  Cells 

SN  1 P (1 C B ).4  X  9 
Relative  Error 

Cumulative  CPU  Sec. 

(Local) 

(G  lobal) 

(Local) 

(Global) 

1 

4.0 

2.5 

1 

9.0 

1.0 

2 

1.1 

1.2 

9.7 

3 

4.0 

4.0 

2.2 

3 

0.42 

0.47 

15.4 

4 

1.5 

1.7 

3.8 

4 

0.16 

0.42 

17.7 

9 

0.72 

1.0 

8.2 

6 

0.14 

0.14 

31.7 

16 

0.50 

0.87 

14.8 

7 

0.064 

0.16 

32.9 

31 

0.42 

0.39 

25.1 

8 

0.064 

0.16 

34.3 

49 

0.19 

0.33 

42.6 

10 

0.022 

0.10 

43.3 

75 

0.16 

0.47 

65.8 

12 

0.031 

0.031 

48.3 

98 

0.23 

0.19 

91.3 

13 

0.015 

0.065 

52.2 

140 

0.10 

0.16 

129.1 

14 

0.016 

0.015 

56.3 

207 

0.078 

0.088 

189.1 

15 

0.0036 

0.015 

59.8 

269 

0.044 

0.049 

239.9 

16 

0.0063 

0.0063 

66.1 

351 

0.025 

0.037 

308.7 

439 

0.018 

0.020 

373.5 

535 

0.0099 

0.011 

465.0 

543 

0.0099 

0.0099 

481.6 

SN  I P ( I B ) .4  x  9  requires  16  cells  and  84.0  seconds  to 
achieve  a  global  relative  error  of  1%.  SN  I P ( I C B ) .7  x  5 
requires  15855.2  seconds  to  form  1116  cells  with  a  relative 
error  of  2.1%  (at  which  point  the  algorithm  was  prema¬ 
turely  terminated),  and  SN  I  P(  I C  B )  .4  x  9  achieves  a  rela¬ 
tive  error  of  1%  with  358  cells  in  4134.5  seconds. 
Contrasting  these  values  with  those  in  T ables  1 1  and  1 1 1 ,  we 
see  that  the  local/global  refinement  procedure,  which  pro¬ 
vides  a  formal  mechanism  for  deciding  how  many  cells  to 
subdivide  prior  to  resolving  the  lower  bounding  problem, 
can  lead  to  significant  computational  savings. 

Table  IV  reveals  how  problem  difficulty  varies  with  the 
size  of  the  interdiction  budget.  When  R  =  0  or  R  s*  24, 
SN  I P ( I C  B )  .4  x  9  reduces  to  a  stochastic  maximum  flow 
problem  with  unreliable  arcs  (e.g.,  Carey  and  H  endrickson 
(1984),  Evans  (1976))  because  the  optimal  first-stage  deci¬ 
sion  is  trivial.  However,  in  this  case,  computing  tight 
bounds  on  the  expected  maximum  flow  still  requires  a 
fairly  fine  partition  with  corresponding  computational 
effort. 


For  general  R,  the  master  problem  is  a  difficult  integer 
knapsack  problem  with  a  piecewise  linear  objective  func¬ 
tion  formed  by  optimality  cuts.  (Of  course,  for  our  test 
problems,  the  knapsack  problem  by  itself  is  quite  simple 
since  r,7  =  1  for  all  interdictable  arcs.)  The  results  show 
that  for  moderate  values  of  R  the  problem  is  most  difficult. 
A  finer  partition  is  required  to  close  the  gap  between 
bounds  when  these  values  are  moderate,  so  there  are  more 
master  problems  and  subproblems  to  solve.  A  Iso,  the  more 
partitions  there  are,  the  more  master-problem  cuts  there 
tend  to  be  and  the  integer  master  problems  become  harder 
and  harder  to  solve.  Our  implementation  solves  each  mas¬ 
ter  problem  from  scratch  and  increased  efficiency  could 
probably  be  achieved  by  using  information  from  previous 
iterations  for  initial  solution  and  bounding  purposes. 

Table  V  shows  that  the  bounds  are  the  weakest,  and 
hence  require  finer  partitions,  when  the  uncertainty  re¬ 
garding  arc  existence  is  greatest,  i.e.,  when  c/j,7  =  0.5.  Even 
small  deviations  from  0.5,  particularly  to  larger  values, 
make  the  problem  significantly  easier.  The  asymmetry  in 


Table  IV 

SN  I P  ( I C  B )  .4  x  9  with  4 >ij  =  0.9  and  p/y-  =  0.75  for  Various  Interdiction  Resource  Budgets 


Budget 
Value  R 

N  urn.  of 
Cells 

M  aster  Probs.  Solved 

Subproblems  Solved 

T  otal 
CPU  Sec. 

(Number) 

(CPU  Sec.) 

(N umber  for 
Lower  Bnd.) 

(N  umber  for 

U  pper  Bnd.) 

(CPU  Sec.) 

0 

56 

0 

0.0 

2290 

2145 

18.6 

22.6 

3 

93 

37 

3.5 

4681 

4068 

37.9 

45.8 

6 

543 

151 

102.8 

47205 

26100 

417.3 

581.6 

9 

725 

195 

226.4 

80440 

37030 

731.1 

995.4 

12 

768 

106 

24.4 

74335 

43089 

492.3 

595.9 

15 

474 

47 

0.5 

36097 

28823 

237.6 

295.2 

18 

362 

25 

0.11 

25447 

24240 

174.3 

271.6 

21 

422 

27 

0.13 

33176 

31345 

224.4 

281.6 

24 

287 

0 

0.0 

23911 

23033 

161.6 

202.4 

Note:  all  problems  are  solved  to  within  a  relative  error  of  0.01. 
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Table  V 

SN I P ( I C B ) .7  x  5  with  R  =  0  for  V  arious  A  rc 
Existence  Probabilities 


4>/; 

N umber  of  Cells 

CPU  Sec. 

Objective  Bounds 

0.9 

53 

20.0 

[181.5, 183.3] 

0.7 

1063 

342.8 

[138.1, 139.5] 

0.55 

2217 

697.3 

[101.4,  102.4] 

0.5 

6496 

1954.9 

[89.10,  89.99] 

0.45 

5033 

1527.7 

[77.02,  77.78] 

0.3 

1112 

359.0 

[43.59,  44.02] 

0.1 

185 

65.1 

[10.32,  10.42] 

Note:  all  problems  are  solved  to  within  a  relative  error  of  0.01. 


T able  V  is  due,  in  part,  to  the  fact  that  a  1%  relative  error 
is  more  difficult  to  achieve  when  the  objective  function 
values  are  smaller,  i.e.,  when  <f>,y  is  smaller.  However,  an 
absolute  error  termination  criterion  would  reverse  the 
asymmetry. 

5.3.  Larger  Test  Problems 

Table  I  indicates  that  SN  I  P(l  B ) .10  x  10  and  SN  I  - 
P ( I C B ) .10  x  10  are  significantly  larger  than  the  problems 
analyzed  above,  particularly  with  respect  to  the  number  of 
the  random  parameters.  Certain  special  cases  of  the  10  x 
10  models  are  tractable  with  respect  to  the  proposed  solu¬ 
tion  technique.  Table  VI  shows  the  effort  required  to 
achieve  various  relative  errors  for  a  "highly"  reliable  sto¬ 
chastic  maximum  flow  problem  (R  =  0)  with  arc  existence 
probabilities  of  0.95.  The  total  number  of  upper-  and 
lower-bounding  subproblems  solved  to  achieve  a  relative 
error  of  1%  is  just  over  1  x  106.  Table  VII  illustrates  that 
SN  I P ( I B ) .10  x  10  is  tractable  when  the  interdiction  bud¬ 
get  is  relatively  small.  As  expected,  the  computational  ef¬ 
fort  to  solve  the  integer  master  problem  grows 
exponentially  with  R  and  quickly  becomes  unmanageable. 

6.  CONCLUSIONS 

This  paper  has  studied  stochastic  variants  of  a  network 
interdiction  problem  where  an  interdictor  attempts  to  de¬ 
stroy  arcs  in  a  capacitated  network  through  which  an  ad¬ 
versary  will  subsequently  maximize  flow.  The  problem  is 
formulated  as  a  mixed-integer  stochastic  program  with  a 
"min-max"  objective,  although  it  is  possible  to  convert  this 
to  a  more  standard  stochastic  integer  program  with  a  min¬ 
imizing  objective. 

The  stochastic  variants  include  cases  where  one  or  more 
uncertain  interdiction  attempts  may  be  made,  cases  where 


Table  VI 

Relative  Error  vs.  CPU  Time  for  SN  I P  ( I C  B )  .10  x  10 
with  4>ij  =  0.95  and  R  =  0. 


N umber  of  Cells 

Relative  E rror 

Cumulative  CPU  Sec. 

115 

0.048 

329.5 

625 

0.024 

1623.5 

2993 

0.012 

7598.2 

4201 

0.0099 

10684.4 

the  arc  capacities  are  random  variables,  and  certain  com¬ 
binations  and  extensions  of  these  cases.  The  objective  of 
the  problem  is  to  plan  interdictions  so  that  the  expected 
maximum  flow,  after  interdiction  attempts  are  made,  is 
minimized.  The  models  for  these  problems  are  two-stage 
stochastic  programs  with  recourse. 

We  develop  a  sequential  approximation  algorithm  for 
solving  these  problems  that  recursively  refines  a  partition 
of  the  state-space  of  the  random  variables  to  improve  up¬ 
per  and  lower  bounds  on  the  objective.  J  ensen’s  inequality 
applied  in  the  usual  fashion  to  the  "natural  formulation" 
of  the  models  leads  to  upper  bounds.  A  key  result  allows 
us  to  reformulate  each  model  so  that  Jensen’s  inequality 
can  also  be  used  to  compute  lower  bounds.  An  important 
computational  advantage  of  our  bounding  models  is  that 
their  size  increases  only  with  the  number  of  elements  in 
the  state-space  partition,  not  with  the  number  of  stochastic 
parameters. 

The  natural  formulation  of  the  model  minimizes  a  con¬ 
cave  function  with  respect  to  the  convex  hull  of  the  integer 
first-stage  feasible  region.  An  equivalent  reformulation 
yields  a  convex  recourse  function  over  the  same  space  and 
thus  allows  direct  application  of  an  integer  L-shaped 
method.  This  reformulation  makes  the  problem  tractable. 
Two  examples  showed  that  the  value  of  the  stochastic  so¬ 
lution  can  be  quite  large  for  stochastic  network  interdic¬ 
tion  problems  (greater  than  50%  for  one  example). 
Computational  results  for  a  number  of  test  problems  dem¬ 
onstrated  the  merit  of  the  proposed  solution  technique. 

It  is  clear  that  the  key  reformulation  technique  of  this 
paper  leads  to  a  new  method  for  evaluating  the  expected 
maximum  flow  in  a  stochastic  network.  The  reader  may 
also  see  that  the  technique  can  be  applied  to  other  sto¬ 
chastic  network  problems  dealing  with  reliability,  shortest 
path  length,  project  completion  date  in  a  PERT  problem, 
etc.  We  are  already  programming  algorithms  to  solve  these 
problems  and  exploiting  the  reformulation  technique  in  a 
number  of  other  stochastic  network  models.  We  are  also 
developing  analogous  bounds  for  more  general  stochastic 
programs. 
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Table  VII 


SN I P ( I  B ) .10  x  10  with  Pij  =  0.75  for  Various  Interdiction  Resource  Budget  Values 


Budget  V alue  R 

N  umber  of  Cells 

M  aster  Problems 

(Number)  (CPU  Sec.) 

Subproblems 

(Total  Num.)  (CPU  Sec.) 

Total  CPU  Sec. 

5 

15 

26 

34.2 

325 

2.9 

38.5 

6 

11 

43 

295.8 

327 

3.5 

300.7 

7 

14 

64 

1668.5 

401 

4.2 

1674.2 

8 

63 

145 

23927.7 

3114 

32.6 

23970.5 

Note:  all  problems  are  solved  to  within  a  relative  error  of  0.01. 
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